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ABSTRACT 

A general-purpose optiaization program for engineering design is 
described, AOS ( Automated Design Synthesis) Version 1.10 is a FORTRAN 
program for solution of nonlinear constrained optiaization probleas. The 
program is segmented into three levels, being strategy, optimizer, and one- 
dimensional search. At each level, several options are available so that a 
total of over 100 possible combinations can be created. Examples of 
available strategies are sequential unconstrained minimization, the 
Augmented Lagrange Multiplier method and sequential quadratic programming. 
Available optimizer include variable metric methods and the method of 
feasible directions as examples. A modified method of feasible directions, 
similar to the generalized reduced gradient method is included also. One- 
dimensional search options include the Golden Section method, polynomial 
interpolation, and combinations of these. 

AOS version 1.10 contains several enhancements. These include general 
program organization, addition of equality constraints to all options in 
the program, and addition of a new convex linearization strategy. 

Emphasis is placed on ease of use of the program. All information is 
transferred via a single parameter list. Default values are provided for 
all internal program parameters such as convergence criteria, and the user 
is given a simple means to over-ride these, if desired. 

The program is demonstrated with a simple structural design example. 


Acknowledgement: A portion of the program enhancements described herein 
were funded by the Optimization Users' Group, sponsored by EDO, Inc., Santa 
Barbara, CA. 
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lA INTRODUCTION 


ADS is a general purpose numerical optimization program containing 
a wide variety of algorithms. The problem solved is: 

Minimize F(X) 


Subject to; 

Gj(X) < 0 j=l.m 

Hk(X) = 0 k=l, 1 

XLi < Xi < XUi i=l,n 


The solution of this general problem is separated into three basic 
levels: 

1. STRATEGY - i^r example, Sequential Unconstrained Minimization or 
Sequential Linear Programming. 

2. OPTIMIZER - For example, Variable Metric methods for unconstrained 
minimization or the Method of Feasible Directions for constrained 
minimization. 

3. ONE-DIMENSIONAL SEARCH - For example, Golden Section or Polynomial 
Interpolation. 

Additionally, we may consider another component to be problem 
formulation. It is assumed that the engineer makes every effort to 
formulate the problem in a form amenable to efficient solution by 
numerical optimization. This aspect in perhaps the most important 
ingredient to the efficient use of the ADS program for solution of 
problems of practical significance. 

By choosing the Strategy, Optimizer and One-Dimensional Search, the 
user is given considerable flexibility in creating an optimization 
program which works well for a given class of design problems. 

This manual describes the use of the ADS program and the available 
program options. Section 1.1 describes the enhancements and 
modifications to the ADS program subsequent to Version 1.00 (ref. 1). 
Section 2 identifies the available optimization strategies, optimizers 
and one-dimensional search algorithms. Section 3 defines the program 
organization, and Section 4 gives user instructions. Section 5 presents 
several simple examples to aid the user in becoming familiar with the 
/OS program. Section 6 gives a simple main program that is useful for 
general design applications. 
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Li.1 Enhan cem ents and Modifications to Version 1^00 

Since the release of Version 1.00 in May of 1984, several 
modifications and enhancements have been made to the program. Many of 
these are minor and are transparent to the casual user. These include 
various formatting changes, internal logic enhancements to improve 
program flow, and a few actual bugs in the FORTRAN. Because of the 
robustness of the basic program, where program bugs exist, their 
correction often is detected only in special test cases. Examples of 
this are enhancement of the automatic scaling of unconstrained problems, 
correction of an error in using the absolute convergence criteria and 
correction of polynomial one-dimensional search when a constraint is 
being followed. Other enhancements include checking to insure the 
initial design does not violate any side constraints, and checking to be 
sure the combinations of strategy, optimizer and one-dimen3ional search 
are valid. 

Enhancements to the program, beyond the original capability, 
include addition of equality constraint capability throughout the 
program and addition of a new strategy. 

Bquality constraints are now available in all options of the 
program, whereas in Version 1.00 they were only available wher using 
penalty function strategies. Specifically, equality constraints have 
been added to optimizers 4 and 5. Here, two approaches were 
investigated. The first was to formally treat them in a mathematical 
sense. This requires considerable program logic and usually insures 
rather precise following of the constraints, but at some efficiency 
cost. The second approach, and that used here, was to treat equality 
constraints via a linear penalty function and an equivalent inequality 
constraint. The basic concept is to first change the sign on the 
constraint, if necessary, so that the scalar product of the gradient of 
the constraint with the gradient of the objective function is negative. 
The constraint is then converted to a non-positive inequality constraint 
and a linear penalty is added to the objective. The penalty, together 
with the conversion to an inequality constraint have the effect of 
driving the original equality constraint to zero at the optimum, but 
without demanding precise accuracy, with its corresponding inefficiency. 
Thia is in keeping with the general phylosophy of ADS of finding a near 
optimum design quickly. 

A new strategy (ISTRAT=9), called Sequential Convex Programming, 
developed by Fleury and Briabant (ref. 2), has been added to ADS. The 
basic concept of this strategy is that a linear approximation to the 
objective and constraint functions is first created, just as in 
sequential linear programming. However, during the approximate 
optimization sub-problem, either direct or reciprocal variables are 
used, depending on the sign of the corresponding components of the 
gradients. This creates a conservative convex approximation to the 
optimization problem. In reference 2, the method was applied to 
structural optimization problems in which all design variables were 
positive. It was shown that move limits were not required during the 
sub-problem and that the method converged quickly to the optimum. When 
incorporating the algorithm into ADS, move limits were included, but 
they are less stringent than for sequential linear programming. This is 
based on the experience that the design space can become ill-conditioned 
in some general applications. Also, reciprocal variables are only used 
if the design variable is positive. It should be emphasized here that 
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this algorithm as well as its implementation into ADS is new and 
enhancements can be expected. Initial experience, especially with 
structural optimization problems , has shown the algorithm to be a 
powerful one. In Version 1.10 of ADS, this algorithm is used in 
conjunction with a general optimizer. Reference 2 uses a dual 
algorithm, for which this method is well suited. It is expected that 
this strategy will be modified to take advantage of duality as applied 
to separable problems such as this in the future. 


2^0 P ROGRAM OPT IONS 

Tn this section, the options available in the ADS program are 
identified. At each of the three solution levels, several options are 
available to the user. 


2 A St rategy 

Table 1 lists the strategies available. Hie parameter ISTRAT will 
be sent to the ADS program to identify the strategy the user wants. The 
ISTRAT=0 option would indicate that control should transfer directly to 
the optimizer. This would be the case, for example, when using the 
Method of Feasible Directions to solve constrained optimization problems 
because the optimizer works directly with the constrained problem. On 
the other hand, if the constrained optimization problem is to be solved 
by creating a sequence of unconstrained minimizations, with penalty 
functions to deal with constraints, one of the appropriate strategies 
would be used. 

TABLE 1: STRATEGY OPTIONS 

ISTRAT STRATEGY TO BE USBD 


0 None. Go directly to the optimizer. 

1 Sequential unconstrained minimization using the exterior 
penalty function method (refs. 3, 4). 

2 Sequential unconstrained minimization using the linear 
extended interior penalty function method (refs. 5-7). 

3 Sequential unconstrained minimization using the quadratic 
extended interior penalty function method (refs. 8, 9). 

4 Sequential unconstrained minimization using the cubic 
extended interior penalty function method (ref. 10). 

5 Augmented Lagrange Multiplier method (refs. 11-15). 

6 Sequential Linear Programming (refs. 16, 17). 

7 Method of Centers (method of inscribed hyperspheres) 

(ref. 18). 

8 Sequential Quadratic Programming (refs. 13, 19, 20). 

9 Sequential Convex Programming (ref. 2). 


2^2 Op tim i zer 

Table 2 lists the optimizers available. IOPT is the parameter used 
to indicate the optimizer desired. 
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TABLE 2: OPTIMIZER OPTIONS 


IOPT OPTIMIZER TO BE USED 


0 None. Go directly to the one-dimensional search. This 
option should be used only for program development. 

1 Fletcher-Reeves algorithm for unconstrained minimization 
(refs. 21). 

2 Davidon-Fletcher-Powell (DFP) variable metric method for 
unconstrained minimization (refB. 22, 23). 

3 Broydon-Fletcher-Goldfarb-Shanno (BFGS) variable metric 
method for unconstrained minimization (refs. 24-27). 

4 Method of Feasible Directions (MFD) for constrained 
minimization (refs. 28, 29). 

5 Modified Method of Feasible Directions for constrained 
minimization (ref. 30). 


In choosing the optimizer (as well as strategy and one-dimensional 
search) it is assumed that the user is knowledgeable enough to choose 
an algorithm consistent with the problem at hand. For example, a 
variable metric optimizer would not be used to solve constrained 
problems unless a stratejgy is used to create the equivalent 
unconstrained minimization task via some form of penalty function. 


2.3 One- Dimensional Search 

Table 3 lists the one-dirersional search options available for 
unconstrained and constrained problems. Here IONED identifies the 
algorithm to be used. 

TABLE 3: ONE-DIMENSIONAL SEARCH OPTIONS 

IONED ONE-DIMENSIONAL SEARCH OPTION (refs. 3, 31, 32) 


1 Find the minimum of an unconstrained function using the 
Golden Section method. 

2 Find the minimum of an unconstrained function using the 
Golden Section method followed by polynomial interpolation. 

3 Find the minimum of an unconstrained function by first 
finding bounds and then using polynomial interpolation. 

4 Find the minimum of an unconstrained function by polynomial 
interpolation/extrapolation without first finding bounds on 
the solution. 

5 Find the minimum of an constrained function using the 
Golden Section method. 

6 Find the minimum of an constrained function using the 
Golden Section method iollowed by polynomial interpolation. 

7 Find the minimum of an constrained function by first 
finding bounds and then using polynomial interpolation. 

8 Find the minimum of an constrained function by polynomial 
interpolation/extrapolation without first finding bounds on 
the solution. 
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2 A Allowable Combinations of Algorithms 


Not all combinations of strategy, optimizer and one-dimensional 
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Is not meaningful when minimising unconstrained functions. 

Table 4 identifies the combinations of algorithms which are 
available in the ADS program. In this table, on X is used to denote an 
acceptable combination of strategy, optimizer and one-dimensional 
search. An example is shown by the heavy line on the table which 
indicates that constrained optimization is to be performed by the 
Augmented Lagrange Multiplier Method (ISTRAT=5), using the BFGS 
optimizer (I0PT=3) and polynomial interpolation with bounds for the one- 
dimensional search (10NED=3). From the table, it is clea" that a large 
number of possible combinations of algorithms are available. 


TABLE 4: PROGRAM OPTIONS 
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Appendix A contains an annotated version of Table 4 for convenient 
reference once the user is familiar with ADS. 

To conserve computer storage, it may he desirable to use only those 
subroutines in the ADS system needed for a given combination of ISTRAT, 
IOPT and IONED. Appendix C provides the information necessary for this. 
Appendix D lists the subroutines with a very brief description of each. 


3^0 PROGRAM FLOW LOGIC 

ADS is called by a user-supplied calling program. ADS does not 
call any user supplied subroutines. Instead, ADS returns control to the 
calling program when function or gradient information is needed. The 
required information is evaluated and ADS is called again. This 
provides considerable flexibility in program organization and restart 
capabilities. 
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ADS can be used in four principal Bodes: 

1. Default Control parameters and finite difference gradients. 

2. Over-ride default parameters, use finite difference gradients. 

3. Default control parameters and user-supplied gradients. 

4. Over-ride default parameters and user-supplied gradient. 

The first mode is the simplest "black box" approach. In the second 
mode, the user over-rides the default parameters to "fine tune" the 
proiifram for efficiency. In modes 3 and 4, the user supplies all needed 
gradient information to the program. 

Figure 1 is the program flow diagram for the simplest use of ADS. 
The user begins by defining the basic control parameters and arrays (to 
be described in Section 4). The gradient computation parameter, IGRAD, 
is set to zero to indicate that finite difference gradients will be 
used. The information parameter, INFO, is initialized to zero and ADS 
is called for optimization. Whenever the values of the objective, OBJ, 
and constraints, 0(1), I=1,NC0N, are required, control is returned to 

the user with INF0=1. The functions are then evaluated and ADS is 
called again. When INFO=0 is returned to the user, the optimization is 
coaplete. 


BBGIN 

DIMENSION ARRAYS 
DEFINE BASIC VARIABLES 
IGRAD <— 0 
INFO <— 0 


»CALL ADS (INFO . . . ) 



OBJECTIVE OPTIMIZATION IS 

AND COMPLETE OR AN ERROR 

CONSTRAINTS WAS DETECTED 

I I 

Figure 1: Simplified Pi o*. am Usage; All Default 

Parameters and Finite Difference Gradients 
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Figure 2 is the prof ran flow diagram for the case where the user 
wishes to over-ride one or more internal parameters, such as convergence 
criteria or maximum number of iterations. Here, after initial? ~'’on of 
basic parameters and arrays, the inforaatioii parameter, INr Y ... . - to 
-2. ADS is then called to initialize all internal pa; extern rd 
allocate storage space for internal arrays. Control is the'; returned .o 
the usar, at which point these parameters, for example convergence 
criteria, can be over-ridden if desired. At this point, the information 
parameter, INFO, will have a value of -1 and should not be changer ADS 
is then called again and the optimization proceeds. Section 4.3 
provides a list of internal parameters which may be modified, along with 
their locations in the work arrays NK and INK. 


BEGIN 


DIMENSION ARRAYS 


DEFINE BASIC VARIABLES 
IGRAD <— 0 
INFO < 2 


CALL ADS (INFO . . . ) 

IF INFO=0, BXIT. ERROR WAS DETECTED 
BLSE 

OVER-RIDE DBFAULT PARAMETERS IN 
ARRAYS WK AND IWK IF DBSIRED 


> CALL ADS (INFO . . . ) 



EVALUATE 

OBJECTIVE 

Ai\T) 

CONSTRAINTS 


EXIT 

OPTIMIZATION 
IS COMPLETE 


Figure 2; Program Flow Logic; Over-ride Default 
Parameters, Finite Difference Gradients 


Figure 3 is the flow diagram for the case where the user wishes to 
provide gradient formation to ADS, rather them having ADS calculate 
this information us.og finite difference methods. In Figure 3, it is 
also assumed that the user will over- ide some internal parameters, so 
the difference between Figures 2 and 3 is that IGRAD is now set to 1 and 
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the user will :iow provide gradients during optimization. If the user 
does not wish to over-ride any default parameters, INFO is initialized 
to zero and the first call to AOS is omitted (as in Figure 1). Now, 
when control is returned to the user, the informstion parameter will 
have a value of 1 or 2 (if INPO=0, the optimization is cosiplece, as 
before). If INFO=l, the objective and constraint functions are 
evaluated and AOS is called again, just as in Figure 2. If INF0=2, the 
gradient, OF, of the objective function is evalueted as well as the 
gradients of NGT constraints defined by vector IC. 


BEGIN 

DIMENSION ARRAYS 
DEFINE BASIC VARIABLES 
IGRAD <— 1 
INFO < 2 

CALL ADS (INFO . . . ) 

IF INFO=0, EXIT. ERROR WAS DETECTED 
ELSE 

OVER-RIDE DBFAULT PARAMETERS IN 
ARRAYS WK AND IWK IF DESIRED 



Figure 3: Program Flow Logic; Over-ride Default 

Parameters and Provide Gradients 
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4^0 USER INSTRUCTIONS 

In this section, the use of the ADS program is outlined. The 
FORTRAN Call statement to ADS is given first, and ther the parameters in 
the calling statement are defined. Section 4.3 identifies parameters 
that the user may wish to over-ride to make more effective ute of ADS. 
Arrays are designated by boldface print. 


41 Cal lin g Statement 

ADS is invoked by the following FORTRAN calling statement in the 
user's program: 

CALL ADS ( INFO, ISTRAT, I OPT, IONED, IPRINT, IGRAD.NDV, NCON, X, 

* VLB, VUB,0BJ,G, IDG.NGT, IC,DF, A, NRA, NCOLA, WK, NRWK, INK.NRIWK) 


4^2 Definitions of Parameters in the ADS Calling Statement 

Table 5 lists the parameters in the calling statement to ADS. Where 
arrays are defined, the required dimension size is given as the array 
argument . 

TABLE **: PARAMETERS IN THE ADS ARGUMENT LIST 

PARAMTER DEFINITION 


INFO Information parameter. On the first call to ADS, INFO=0 or -2. 

INFO=0 is used if the user does not wish to over-ride internal 
parameters and INFU=-2 is used ±f internal parameters are to be 
changed. When control returns form ADS to the calling program, 
INFO will have a value of 0, 1, or 2. If INFO=0, the 
optimization is complete. If INF0=1, the user must evaluate 
the objective, OBJ, and constraint functions, 0(1), I=1,NC0N, 
and call ADS again. If INF0=2, the user must evaluat the 
gradient of the objective and the NGT constraints identified by 
the vector IC, and ct'll ADS again. If the gradient calcula. ion 
control, IGRAD=0, INF0=2 will never be returned from ADS, and 
all gradient information is calculated by finite difference 
within ADS. 

ISTRAT Optimization strategy to be used. Available options are 
identified in Tables 1 and 4. 

IOPT Optimizer to be used. Available options are identified i.. 
Tables 2 and 4. 

IONED One-dimensional search algorithm to ‘>e used. Available options 
are identified ir Tables 3 and 4. 
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TABLE 5 CONTINUED: PARAMETERS IN THE ADS ARGUMENT L^ST 

PARAMETER DEFINITION 


IPRINT A four-digit print control. IPRINT=IJKL where I, J, K and L 
heve the following definitions: 

I ADS system print control. 

0 - No print. 

1 - Print initial and final information. 

2 - Same as 1 plur parameter values and storage needs. 

3 - Same as 2 plus scaling information calculated by ADS. 

J Strategy print control. 

0 — No print. 

1 - Print initial and final optimisation information. 

2 - Same as 1 plus OBJ and X at e&ch iteration. 

3 - Same as 2 plus Q at each iterat on. 

4 - Same as 3 plus intermediate information. 

5 - Same as 4 plus gradients of constraints. 

K Optimizer print control. 

0 - No print. 

1 - Print initial and final optimization information. 

2 - Same as 1 plus OBJ and X at each iteration. 

3 - Same as 2 plus constraints at each iteration. 

4 - Same as 3 plus intermediate optimization and 

one-dimensional search information. 

5 - Same as 4 plus gradients of constraints. 

L One-Dimensional search print control, (debug only). 

0 - No print. 

1 - One-dimensional search debug information. 

2 - More of the same. 

Example: IPRINT=3120 corresponds to 1=3, J=l, K=2 and L=0. 

NOTE: IPRINT can be changed at any time control is returned to 

the user. 

IGRAD Gradient calculation control. If IGRAD=0 is input to ADS, all 
gradient computations a~e done within ADS by first forward 
finite difference. If IGRAD=1, the user will supply gradient 
information as indicated by t u e value of INFO. 

NDV Number of design variables contained in vector X. NDV is the 

same as n in the mathematical problem statement. 

NCON Number of constraint values contained in array G. NCON is the 
same as m+ in the mathematical problem statement given in 
Section 1.0. NCON=0 is allowed. 

X(NDV+1) Vecto^ containing the design variables. On the first call to 
ADS, this is the user's initial estimate to the design. On 
returr from ADS, this is the design for which function or 
gradient values are required. On the final return from ADS 
(INFO=) is returned), the vector X contains the optimum design. 

VLB(NDV+1) Arra'j containing lower bounds on the design variables, X. If 
no lower bounds are imposed on one or more of the design 
variables, the corresponding component (s) of VLB must be set to 
a large negative number, say -1.0E+15. 

VUB(NDV=1) Array containing upper bounds on the design variables, X. If 
no upper bounds are imposed on one or more of the design 
variables, the corresponding component (s) of VUB must be set to 
a large positive number, say 1.0B+15. 
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TABLE 5 CONTINUED: PARAMETERS IN THE ADS ARGUMENT LIST 

PAMAWTKK DEFINITION 


Value of the objective function corresponding to the current 
values of the design variables contained in X. On the first 
call to ADS, OBJ need not be defined. ADS will return a value 
of INF0=1 to indicate that the user must evaluate OBJ and call 
ADS again. Subsequently, any time a value of INF0=1 is 
returned from ADS, the objective, OBJ, must be evaluated for 
the current design and ADS must be called again. OBJ has the 
same meaning as F(X) in the mathematical problem statement 
given in Section 1.0. 

Array containing NCON constraint values corresponding to the 
current design contained in X. On the first call to ADS, the 
constraint values need not be defined. On return from ADS, if 
INFO-1, the constraints must be evaluated for the current X and 
ADS called again. If NCON=0, array G should be dimensioned to 
unity, but no constraint values need to be provided. 

IDG(NCON) Array containing identifiers indicating the type of the 
constraints contained in array G. 

IDG(I) = -2 for linear equality constraint. 

IDG(I) = -1 for nonlinear equality constraint. 

IDG(I) = 0 or 1 for nonlinear inequality constraint. 

IDG(I) = 2 for linear inequality constraint. 

NGT Number of constraints for which gradients must be supplied. 

NGT is defined by ADS as the minimum of NCOLA and NCON and is 
returned to the user. 

IC(NGT) Array identifying constraints for which gradients are required. 
IC is defined by ADS and returned to the user. If INFO-2 is 
returned to the user, the gradient of the objective and the NGT 
constraints must be evaluated and stored in arrays DF and A, 
respectively, and ADS must be called again. 

DF(NDV+1) Array containing the gradient of the objective corresponding 
to the current X. Array DF must be defined by the user when 
INF0=2 is returned from ADS. This will not occur if IGRAD=0, 
in which case array DF is evaluated by ADS. 

A(NRA, NCOLA) Array containing the gradienvs of the NGT constraints 

identified by array IC. That is, column J of array A contains 
the gradient of constraint number X, where K=IC(J). Array A 
must be defined by the user when INFC=2 is returned from ADS 
and when NGT.GT.O. This will not occur if IGRAD-0, in which 
case, array A is evaluated by ADS. NRA is the dimensioned 
rows of array A. NCOLA is the dimensioned columns of array A. 

NRA Dimensioned rows of array A, NRA must be at least NDV+1. 

NCOLA Dimensioned columns of array A. NCOLA should be at least the 

minimum of NCON and 2*NDV. If enough storage is available, and 
if gradients are easily provided or are calculated by finite 
difference, then NCOLA=NCON+NDV is ideal. 

WR(NRWK) User provided work array for real variables. Array WE is used 
to store internal scalar variables and arrays used by ADS. WK 
must be dimensioned at least 100, but usually much larger. If 
the use has not provided enough storage, ADS will print the 
appropriate message and terminate the optimization. 


OBJ 


G(NCON) 
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TABU 5 CONCLUDED: PARAMTTE!?* IN THE ADS ABOUMRNT LIST 

PARAMETER DEFINITION 


NHWK Dimensioned size of work array ML. A good estimate is 

NHWK = 500 + 10*(NDV+NCON) + NC0LA*(HC0LA+3) +N*(N/2+l), where 
N = MAX(NDV.NCOLA). 

UKOTdUK) User provided work array for integer variables. Array INK is 
used to store internal scalar variables and arrays used by ADS. 
UK must be dimensioned at least 200, but usually much larger. 
If the user has not provided enough storage, ADS will print the 
appropriate message and terminate the optimization. 

NRIWK Dimensioned size of work array UK. A good estimate is 
NRIWK = 200 + NDV + NCON + N + MAX(N,2*NDV) , where 
N = MAX(NDV.NCOLA) . 


4.3 Over-R iding ADS Default Parameters 

Various internal parameters are defined on the first call to ADS 
which work well for the "average" optimization task. However, it is 
often desirable to change these in order to gain maximum utility of the 
program. This mode of operation is shown in Figures 2 and 3. After the 
first call to ADS, various real and integer scalar parameters are stored 
in arrays ML and UK respectively. Thoae which the user may wish to 
change are listed in Tables 6 through S, together with their default 
values and definitions. If the user wishes to change any of these, the 
appropriate component of WK or UK is simply re-defined after the first 
call to ADS. For example, if the relative convergence criterion, 

n EL0BJ, is to be changed to 0.002, this is done with the FORTRAN 
statement ; 

WK( 12) = 0.002 

because MK(12) contains the value of DELOBJ. 
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TABLE 6: HEAL PARAMETERS STORED IN ARRAY ML 


MODULES WHERE USED 

PARAMETER LOCATION DEFAULT ISTRAT IOPT I OWED 


ALAMDZ 

1 

0.0 

5 

- 

- 

BETAMC 

2 

0.0 

7 

- 

- 

CT(1) 

3 

-0.03 


4,5 

- 

CTL 

4 

-0.005 


4,5 

- 

CTIMIN 

5 

0.001 

- 

4,5 

- 

CTVIN 

6 

0.01 

- 

4,5 

- 

DABALP(2) 

7 

0.0001 

- 

ALL 

- 

DABOBJ 

8 

ABS(F0)/1000 

ALL 

- 

- 

DABOBM 

9 

ABS(F0)/500 

ALL 

- 

- 

DABSTR 

10 

ABS(F0)/1000 

ALL 

- 


DBLALF(3) 

11 

0.005 

- 

- 

1,2, 5, 6 

DELOBJ 

12 

0.001 


ALL 

- 

DELOBM 

13 

0.01 

ALL 

- 

- 

DELSTR 

14 

0.001 

ALL 

- 

- 

DLOBJ1 

15 

0.1 

- 

ALL 

- 

DLOBJ2 

16 

1000.0 

- 

ALL 

- 

DX1 

17 

0.01 

- 

ALL 

- 

DX2 

18 

0.2 

- 

ALL 

- 

EPSPEN 

19 

-0.05 

2,3,4 

- 

- 

EXTRAP 

20 

5.0 

- 


ALL 

FDCH 

21 

0.01 

- 

ALL 

- 

FDCW1 

22 

0.001 

- 

ALL 

- 

GMULTZ 

23 

10.0 

8 

- 


PSAIZ 

24 

0.95 

8 

- 

- 

RMULT 

25 

5.0 

1,5 

- 

- 

HMVIMZ(4) 

26 

0.2 

6, 7, 8, 9 

- 


RP 

27 

10.0 

1,5 

- 

- 

RPMAX 

28 

1.0E+10 

1,5 

- 

- 

RPMULT 

29 

0.2 

1,5 

- 

~ 

RPPMIN 

30 

1.0E-10 

2,3,4 

- 

- 

RPPRIM 

31 

100.0 

2,3,4 

- 

- 

SCFO 

32 

1.0 

ALL 

ALL 

ALL 

SCLMIN 

33 

0.001 

ALL 

ALL 

ALL 

STOL 

34 

0.001 

- 

4,5 

- 

THETAZ 

35 

0.1 

- 

4,5 

- 

XMULT 

36 

2.618034 

- 

- 

1,2, 3, 5, 6, 7 

ZRO 

37 

0.00001 

ALL 

ALL 

ALL 

PMLT 

38 

10.0 

6, 7, 8, 9 

4,5 

- 

1 If IOPT= 

4, CT=-0. 1 




2 If IONED 

=3 or 8, DABALP=0. 

001 



3 If IONED 

=3 or 8, DELALP=0. 

05 



4 If ISTRAT=9, 

HMVLMZ=0.4 




NOTE: FO is 

the 

objective function value 

for the 

initial design. 


13 






TABLE 7: DEFINITIONS OF REAL PARAMETERS CONTAINED IN ARRAY WK 

PARAMETER DEFINITION 


ALAMDZ Initial estimate of the Lagrange Multipliers in the Augmented 
Lagrange Multiplier Method. 

BETAMC Additional steepest descent fraction in the nethod of centers. 
After moving to the center of the hypersphere, a steepest 
descent move is Bade equal to BETAMC times the radius of the 
hyper sphere. 

CT Constraint tolerance in the Method of Feasible Directions or 

the Modified Method of Feasible Directions. A constraint is 
active if its nuBerical value is Bore positive than CT. 

CTL Saae as CT, but for linear constraints. 

CTIMIN Saae as CTMIN, but for linear constraints. 

CTMIN MiniauB constraint tolerance for nonlinear constraints. If a 
constraint is Bore positive than CTMIN, it is considered to 
be violated. 

DABALP Absolute convergence criteria for the one-diaensional search 
when using the Golden Section aethod. 

DABOBJ Maximus, absolute change in the objective between two 
consecutive iterations to indicate convergence in 
optiBization. 

DABOBM Absolute convergence criterion for the optiBization sub- 
problea when using sequential ainiaization techniques. 

DABSTR Saae as DABOBJ, but used at the strategy level. 

DELALP Relative convergence criteria for the one-diaensional search 
when using the Golden Section aethod. 

DELOBJ Maxiaua relative change in the objective between two 
consecutive iterations to indicate convergence in 
optiBization. 

DELOBM Relative convergence criterion for the optiaization sub- 
p rob lea when using sequential ainiaization techniques. 

DELSTR Saae as DELOBJ, but used at the strategy level. 

DL0BJ1 Relative change in the objective function atteapted on the 

first optiaization iteration. Used to estiaate initial aove 
in the one-diaensional search. Updated j the 
optiaization progresses. 

DL0BJ2 Absolute change in the objective function at empted on the 

first optiaization iteration. Used to estic e initial aove 
in the one-dimensional search. Updated as the 
optimization progresses. 

*’K1 Maxiaua relative change in a design variable attempted on the 
first optiaization iteration. Used to estimate the initial 
aove in the one-diaensional search. Updated as the 
optimization progresses. 

DX2 Maximum absolute change in a design variable attempted on the 
first optiaization iteration. Used to estiaate the initial 
aove in tho one-diaensional search. Updated as the 
optimization progresses. 

EPSPEN Initial transition point for extended penalty function 
methods. Updated as the optimization progresses. 

EXTRAP Maxiaua multiplier on the one-dimens icnal search parameter, 
ALPHA in the one-diaensional search using polynomial 
interpolation/extrapolation. 
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TABLE 7 CONCLUDED: DEFINITIONS OF REAL PARAMETERS CONTAINED IN ARRAY NS 

PARAMETER DBF’ NITION 


FDCH 

FDCfW 


GMULTZ 

PSAIZ 

RMULT 

RMVIMZ 


RP 

RPMAX 

RPMULT 

RRPMIN 

RPPRIM 

SCFO 


SCLMIN 

STOL 

THETAZ 

XMULT 

ZRO 

PMLT 


Relative finite difference step when calculating gradients. 
Minima absolute value of the finite difference step when 
calculating gradients. This prevents too saall a step when 
X(I) is near zero. 

Initial penalty parameter in Sequential Quadratic programing. 
Move fraction to avoid constraint violations in Sequential 
Quadratic Programing. 

Penalty function multiplier for the exterior penalty function 
method. Must be greater than 1.0. 

Initial relative move limit. Used to set the move limits in 
sequential linear programing, method of inscribed 
hyperspheres and sequential quadratic programing as a 
fraction of the value of X(I), 1=1, NDV. 

Initial penalty parameter for the exterior penalty function 
method or the Augmented Lagrange Multiplier method. 

Maximum value of RP for the exterior penalty function method 
or the Augmented Lagrange Multiplier method. 

Multiplier on RP for consecutive iterations. 

Minimum value of RPPRIM to indicate convergence. 

Initial penalty parameter for extended interior penalty 
function methods. 

The user-supplied value of the scale factor for the objective 
function if the default or calculated value is to be over- 
ridden. 

Minimum numerical value of any scale factor allowed. 

Tolerance on the components of the calculated search direction 
to indicate that the Kuhn-Tucker conditions are satisfied. 
Nominal value of the push-off factor in the Method of Feasible 
Directions. 

Multiplier on the move parameter, ALPHA, in the one- 
dimensional search to find bounds on the solution. 

Numerical estimate of zero on the computer. Usually the 
default value is adequate. If a computer with a short word 
length is used, ZRO=1.0K-4 may be preferred. 

Penalty multiplier for equality constraints when I0PT=4 or 5. 


TABLE 8: INTEGER PARAMETERS STORED IN ARRAY INK 


PARAMETER 

LOCATION 

DEFAULT 

ICNDIR 

1 

NDV+1 

ISCAL 

2 

1 

ITMAX 

3 

40 

ITHMOP 

4 

3 

ITHMST 

5 

2 

JONED 

6 

TONED 

J1WAX 

7 

20 


MODULES MHBRR USED 


ISTRAT 

IOPT 

IONBD 

- 

ALL 

- 

ALL 

ALL 

ALL 

- 

ALL 


- 

1.2,3 

- 

ALL 

-- 

- 

8 

- 

- 

ALL 

- 

- 
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TABLE 9: DEFINITIONS OF INTEGER PARAMETERS CONTAINED IN ARRAY INK 


PARAMETER DEFINITION 


ICNDIR Restart parameter for conjugate direction and variable metric 
methods. Unconstrained minimization is restarted with a 
steepest descent direction every ICNDIR iterations. 

ISCAL Scaling parameter. If ISCAL=0, no scaling is done. 11 

ISCAL=1, the design variables, objective and constraints are 
scaled automatically. 

UMAX Maximum number of iterations allowed at the optimizer level. 

ITRMOP The number of consecutive iterations for which the absolute or 
relative convergence criteria must be met to indicate 
convergence at the optimizer level. 

ITRKST The number of consecutive iterations for which the absolute or 
relative convergence criteria must be met to indicate 
convergence at the strategy level. 

JONED The one-dimensional search parameter (IONRD) to be used in the 
Sequential Quadratic Programing method at the strategy level. 

JTMAX Maximum number of iterations allowed at the strategy level. 


4.4 User-Supplied Grad ients 

If it is convenient to supply analytic gradients to ADS, rather 
than using internal finite difference calculations, considerable 
optimization efficiency is attainable. If the user wishes to supply 
gradients, the flow logic given in Figure 3 is used. In this case, the 
information parameter, INFO, will be returned to the user with a value 
of INF0=2 when gradients are needed. The user calculates the NGT 
gradients of the constraints identified by array IC and stores these in 
the first NGT columns of array A. That is column I of A contains the 
gradient of constraint J, where J=IC(I). 


4^5 Restarting ADS 

When solving large and complex design problems, or when multi-level 
optimization is being performed, it is often desirable to terminate the 
optimization process and restart from that point at a later time. This 
is easily accomplished using the ADS program. Figure 4 provides the 
basic flowchart for this process. Whenever control is returned from ADS 
to the calling program, the entire contents of the parameter list are 
written to disk (or a file in a database management system). The 
program is then stopped at this point. Later, the program is restarted 
by reading the information bock from disk and continuing from this 
point. If optimization is performed as a sub-problem within analysis, 
the information from the system level optimization is written to disk 
and the analysis is called. The analysis module can then call ADS to 
perform the sub-optimization task. Then, upon return from analysis, the 
system level information is lead back from storage and the optimization 
proceeds as usual. From this, it is seen that considerable flexibility 
exists for multi-level and multi-discipline optimization with ADS, where 
the ADS program is used for multiple tasks within the overall design 
process . 
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The user say wish to stop the optimization at specific tiaes during 
the process. The parameter IMAT is array IWK gives general information 
regarding the progress of the optimization. Appendix B provides details 
of this parameter as well as other parameters stored in WK and nil which 
may be useful to the experienced user of AOS. 


BBGIN 


IS THIS X s 
_ RESTART?. 


CALL ADS ( INFO, . . . ) 

* 


READ CONTENTS OF 
ADS PARAMETER LIST 
FROM DISK FILE 


/ STOP FOR YES 
LATER RESTART > 


WRITE CONTENTS OF 
ADS PARAMETER LIST 
ONTO DISK FILE 


CONTINUE 


Figure 4: Restarting ADS 


4.6 Choosing An Algorithm 

One difficulty with a program such as ADS, which provides numerous 
options, is that of picking the best combination of algorithms to solve 
a given problem. While it is not possible to provide a concise set of 
rules, some general guidelines are offered here based on the author's 
experience. The user is strongly encouraged to try many different 
options in order to gain familiarity with ADS and to improve the 
probability that the best combination of algorithms is found for the 
particular class t<f problems being solved. 


. A. W* 



UNCONSTRAINED FUNCTIONS (NCON^O, Side Constraints OK) 


ISTRAT=0 

Is computer storage very limited? 

Yes - I0PT=1. Are function evaluations expensive? 

Yes - Is the objective known to be approximately quadratic? 

Yes - I0NED=4 
No - IONED- 3 
No - I0NED=1 or 2 
No - Is the analysis iterative? 

Yes - I0PT=3. Are function evaluations expensive? 

Yes - Is the objective known to be approximately quadratic? 

Yes - I0NED=4 

No - I0NED=3 

No - IONED =1 or 2 

No - I0PT=2 or 3. Are function evaluations expensive? 

Yes - Is the objective known to be approximately quadratic? 

Yes - I0NED=4 

No - I0NED=3 

No - IONED^l or 2 


CONSTRAINED FUNCTIONS (NOON 0) 

Are relative minima known to exist? 

Yes - ICTRAT=1, I0PT=3. Are function evaluations expensive? 
Yes - I0NED=3 
No - I0NED=1 or 2 

No - Are the objective and/or constraints highly nonlinear? 
Yes - Are function evaluations expensive? 

Yea - ISTRAT=0, IOPT=4 t IONED=7 
No - ISTRAT=2, 3 or 5, I0PT=2 or 3, IONED=l or 2 
No - Is the design expected to be fully-constrained? 
(i.e. NDV active constraints at the optimum) 

Yes - ISTRAT=6, IOPT=5, I0NED=6 
No - Is the analysis iterative? 


Yes - 

ISTRAT=0, 

I0PT=4 , 

I0NED=7 

or 


ISTRAT=8, 

IOPT=5 , 

I0NED=7 

or 


ISTRAT=9, 

IOPT=5, 

I0NED=7 


No - 

ISTRAT=0, 

IOPT=i» , 

I0NED=7 

or 


ISTRAT=8, 

I0PT=5, 

IONED =7 

or 


ISTRAT=9, 

I0PT=5, 

I0NED=7 



GENERAL APPLICATIONS 

Often little is known about the nature of the problem being solved. 
Based on experience with a wide variety of problems, a very direct 
approach is given here for using ADS. The following table of parameters 
is offered ai. a sequence of algorithms. When using ADS the first few 
times, the user may prefer to run the cases given here, rather than 
using the decision approach given above. It is assumed here that 
a constrained optimization problem is being solved. it' the problem is 
unconstrained, ISTRAT=0, I0PT=3 and IONED =2 or 3 is recommended. 
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ISTRAT IOPT IONBD I PRINT 


8 5 7 2200 

057 2020 

047 2020 

357 2200 

656 2200 

533 2200 

233 2200 

1 3 3 2200 


5.0 EXAMPLES 


Consider the following two-variable optimization problem with two 
nonlinear constraints: 

Minimize OBJ = 2*SQRT(2)*A1 + A2 


2*A1 + SQRT(2)*A2 

Subject to; G( 1) = - 1 

2*Al*[Ai + SORT ( 2 ) *A2 ] 

1 

G(2) = - 1 

2*[A1 + SQRT(2)*A2] 


0.01 < Ai < 1.0E+20 i=l,2 

This is actually the optimization of the classical 3-bar truss shown in 
Figure 5 where, for simplicity, only the tensile stress constraints in 
members 1 and 2 under load PI are included. The loeds, PI and P2, are 
applied separately and the material specific weight is 0.1 lb. per cubic 
inch. The structure is required to be symmetric so X(l) corresponds to 
the cross-sectional area of members 1 and 3 and X(2) corresponds to the 
cross-sectional area of member 2. 





PI = 20000 lb. P2 = 20000 lb. 

Figure 5: Three-Bar Truss 


V 
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5.J.1 Kxangle All Def aul t Par a meters 

Figure 6 gives the FORTRAN program to be used with AOS to solve 
this problem. Only one line of data is read by this program to define 
the values of ISTRAT, IOPT, IONBD and IPRINT and the FORMAT is 415. 
When the optimization is complete, another case may be run by reading a 
new set of data. The program terminates when ISTRAT=-1 is read as data. 

Figure 7 gives the results obtained with ISTRAT=0, I0PT=4, 10NBD=7 
and IPRINT=1000. The reader is encouraged to experiment with this 
program using various combinations of the options from Table 4. 


5J Ex ample Initial P arameter s Are Mo difi ed 

The 3-bar truss designed in Section 5.1 is now designed with the 
following changes in the internal parameters: 

Parameter New Value Location in WK Location in INK 


CT -0.1 3 
CTMIN 0.002 6 
THETAZ 1.0 35 
ITHM0P 2 

The FORTRAN program used here is 
are given in Figure 9. 


4 

shown in Figure 8 and the results 


{k 3 Example 3^ Gra dient s S up plied by the User 

The 3-bar truss designed in Sections 5.1 and 5.2 is designed here 
with user-supplied gradients. The parameters CT, CTMIN, CTMIN, THETAZ 
and ITHM0P are over-ridden as in Section 5.2. Also, new IPRINT=2020 to 
provide a more typical level of optimization output. 

The FORTRAN program associated with this example is given in 
Figure 10. Figure 11 gives the results. 
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C SIMPLIFIED USAGE OF ADS. THE THREE-BAA TRUSS. 

C REQUIRED ARRAYS. 

DIMENSION X(3) , VLB(3) , VUB(3) ,G(2) , IDG(2) , IC(2) ,DF(3) , A(2,2) , 

1 WK( 1000), INK (500) 

C ARRAY DIMENSIONS. 

NRA=2 
NCOLA=2 
NRNK=1000 
NRIWK=500 
C PARAMETERS. 

IGRAD=0 

NDV=2 

NCON=2 

C INITIAL DESIGN. 

X(l)=l. 

X(2)=l. 

C BOUNDS. 

VLB(1)=.01 

VLB(2)=.01 

VUB(l)=1.0B+20 

VUB(2)=1.0E J -20 

C IDENTIFY CONSTRAINTS AS NONLINEAR, INEQUALITY. 

IDG(1)=0 
IDG(2)=0 
C INPUT. 

READ (5, 30) ISTkAT,IOPT,IONED,IPRINT 
C OPTIMIZE. 

INFO=C 

10 CALL ADS ( INFO, ISTRAT, IOPT, IONED, IPRINT, IGRAD,NDV,NCON,X, VLB, 

1 VUB , OBJ , G , IDG.NGT, IC.DF, A,NRA,NCOLA,WK,NRNK, 1WK.NRIWX) 

IF (INFO.EQ.O) GO TO 20 
C EVALUATE OBJECTIVE AND CONSTRAINTS. 

OBJ=2.*SQHT(2.)*X(l)+X(2) 

G(1)=(2.*X(1)+SQRT(2.)*X(2))/(2.*X(1)*(X(1)+SQRT(2.)*X(2)))-1. 

G(2)=.5/(X(1)+SQRT(2.)*X(2))-1. 

C GO CONTINUE WITH OPTIMIZATION. 

GO TO 10 
20 CONTINUE 

C PRINT RESULTS. 

WRITE(6,40) OBJ, X( 1) ,X(2),G(1),G(2) 

STOP 

30 FORMAT (415) 

40 FORMAT (//5X,7HOPTIMUM,5X,5HOBJ =,E12.5//5X,6HX(1 ) =,E12.5,5X, 

1 6HX(2) =,E12.5/5X,6HG( 1) =,B12.5,5X,6H3(2) =,E12.5) 

END 


Figure 6: Example 1; All Default Parameters 
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SSSSSS 

S 

S 

SSSSS 

S 

S 

SSSSSS 


’ ' R T R A N PROORAH 
FOR 

AUTOMATED DESIGN SYNTHESIS 
VERSION l. 10 

CONTROL PARAMETERS 

ISTRAT = 0 I OPT = 4 IONED = 7 IPRINT - 1000 

IGRAD = 0 NDV = 2 NCON = 2 

OPTIMIZATION RESULTS 


OBJECTIVE FUNCTION VALUE .26217B+01 


DESIGN VARIABLES 


VARIABLE 

1 

2 


LOWER 
BOUND 
. 10000B-01 
. 10000E-01 


VALUE 

. 77035B+00 
. 44281B+00 


UPPER 
BOUND 
. 10000E+21 
. 10000E*21 


DESIGN CONSTRAINTS 


1) . 7075E-02 - . 6420E+00 

FUNCTION EVALUATIONS = 56 


OPTIMUM 

OBJ = 

•26217E+01 


X(l) = . 

77035R+00 

X(2) = 

•4428IE+00 

0(1) = . 

70753E-02 

0(2) = 

64IJ8E+00 

Figure 7: 

Bxaaple ] 

. ; Output 
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USAGE OF AOS. OVER-RIDING DEFAULT PARAMETERS. 

THE THREE-BAR TRUSS. 

REQUIRED ARRAYS. 

DIMENSION X(3) , VLB(3) , VUB(3) ,G(2) , IDG(2) , IC(2) ,9F(3) *(2,2), 

1 WK(1000) , IWK(500) 

C ARRAY DIMENSIONS. 

NFA=2 
NCOLA=2 
HHtfK=1000 
NRIVK=500 
C PARAMETERS. 

IG*tAD=0 

NDV=2 

NCON=2 

C INITIAL DESIGN. 

X(l)=l. 

X(2)=l. 

C BOUNDS. 

VLB(1)=.01 

VLB(2)=.01 

VUB(l)=1.0E+20 

VUB(2)=1.0E+20 

C IDENTIFY CONSTRAINTS AS NONLINEAR, INEQUALITY. 

IDG(1)=0 
IDG(2)=0 
C INPUT. 

READ(5,30) ISTKAT, IOPT, IONED, IPRINT 
C INITIALIZE INTERNAL PARAMETERS. 

INFO=-2 

CALL ADS (INFO.ISTRAT, IOPT, IONED, IPRINT, IGRAD,NDV,NCON,X, VLB, 

1 VUB,OBJ,G,IDG,NGT,IC,DF t A.NRA,NCOLA,WK,NHWK,IWK,raiWK) 

C OVER-RIDE DEFAULT VALUES OF CT, CTMIN, THETAZ AND ITHMOP. 

WK(3)=-Q. 1 
WK(6)=0.002 
WK(35)=1.0 
IWK(4)=2 
C OPTIMIZE. 

10 CALL ADS (INFO, ISTRAT, IOPT, IONED, IPRINT, IGRAD,NPV,NCON,X, VLB, 

1 VUB , OBJ , G , IDG.NGT, IC,DF,A,NRA,NCOLA,WK,NHWK, IWK.NRIWK) 

IF (INFO.EQ.O) GO TO 20 
C EVALUATI OBJECTIVE AND CONSTRAINTS. 

OBJ=2.*SQRT(2.)*X(l)+X(2) 

G(l)=(2.*X(l)+SQRT(2.)*X(2))/(2.*X(l)*(X(l)+SQRT(2.)tX(2)))-l. 
G(2)=.5/(X(1)+SQRT(2. )*X(2) )-l. 

C GO CONTINUE WITH OPTIMIZATION. 

GO TO 10 
20 CONTINUE 

C PRINT RBSULTS . 

WRITB(6,40) OBJ, X( l ) ,X(2),G(1),G(2) 

CTOP 

30 FORMAT (415) 

40 FORMAT (//5X,7HOPTIMUM,5X,5HOBJ =,I 12.5//5X,6HX(1) =,E12.5 5X, 

1 6HX(2) =, E12.5/5X,6HG( 1) =,B12.5,5X,6HG(2) =,B12.5) 

END 

Figure 8: Exwnple 2; Modify Default Parameters 
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A AD D 

A AD D 

AAAAAAAi D D 

A AD D 

A AD D 

A A D1IDDDD 


FORTRAN PROGRAM 
FOR 

AUTOMATED DESIGN SYNTHESIS 
VBRSION 1.10 


SSSSSS 

S 

S 

SSS*S 

S 

S 

SSSSSS 


CONTROL 

PARAMETERS 





ISTRAT 

= 0 IOPT = 

4 

IONED = 

7 

IPRINT = 1000 

IGRAD 

= o 

2 

NCON = 

2 



OPTIMIZATION RESULTS 


OBJBCTIVB FUNCTION VALUB .26400E+01 


DESIGN VARIABLES 



LOWER 


VARIABLE 

BOUND 

VALUE 

1 

. 10000E-01 

. 78640E+00 

2 

. 10000B-01 

•41569B+00 


UPPBR 
BOUND 
. 10000B+21 
. 10003E+21 


DESIGN CONSTRAINTS 

1) -.3624E-G3 -.63S2B+00 

FUNCTION EVALUATIONS = 18 

OPTIMUM OBJ = . 26400E+01 


X(l) = . 78640B+00 X(2) = .41569E+00 

G(l) = -.36236E-03 G(2) = -.63617B+00 

Figure 9: Example 2; Output 
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C USAGE OF ADS. OVER-RIDING DEFAULT PARAMETERS, AND PROVIDING 

C GRADIENTS. THE THREE-BAR TRUSS. 

C REQUIRED ARRAYS. 

DIMENSION X(3) , VLB (3) , VUB(3) ,G(2) , IDG(2) , IC(2) , DF(3) , A(2,2) , 

1 WK ( 1000 y,IWK( 500) 

DIMENSION B(2,2) 

C ARRAY DIMENSIONS. 

NRA=2 
NCOLA=2 
NRWK=1000 
NRIWK=500 
C PARAMETERS. 

IGRAD=1 

NDV=2 

NCON=2 

C INITIAL DESIGN. 

X(l)=l. 

X(2)=l. 

C BOUNDS. 

VLB(1)=.01 

V T ?(2)=.01 

VUB(1)=1.0E+20 

VUB(2)=1.0E+20 

C IDENTIFY CONSTRAINTS AS NONLINEAR, INEQUALITY. 

IDG(l) =0 
IDG(2)=0 
C INPUT. 

READ (5, 70) ISTRAT, IOPT, IONED, IPRINT 
C INITIALIZE INTERNAL PARAMETERS. 

INFO=-2 

CALL ADS (INFO, ISTRAT, IOPT, IONED, IPRINT, IGRAD,NDV,NCON, X, VLB, 

1 VUB,OBJ,G, IDG.NGT, IC,DF,A,NRA,NCOLA,WK,NRWK, IWK,NRIWK) 

C OVER-RIDE DEFAULT VALUES OF CT, CTMIN, THETAZ AND ITRMOP. 

WK(3)=-0.1 
WK(6)=0. 002 
WK(35)=1.0 
IWK(4)=2 
C OPTIMIZE. 

10 CALL ADS ( INFO, ISTRAT, IOPT, IONED, IPRINT, IGRAD,NDV,NCON, X, VLB, 

1 VUB.OBJ ,G, IDG.NGT, IC.DF, A,NRA,NCOLA,WK,NRWK, IWK.NRIWK) 

IF (INFO.EQ.O) GO TO 60 
IF (INFO.GT.l) GO TO 20 
C EVALUATE OBJECTIVE AND CONSTRAINTS. 

OBJ=2.*SQRT(2.)*X(l)+X(2) 

G(1)=(2.*X( 1)+SQRT(2. )*X(2) )/(2. *X( 1)*(X( 1)+SQRT(2. )*X(2) ) )-l. 
G(2)=.5/(X( 1)+SQRT(2. )*X(2))-1. 

C GO CONTINUE WITH OPTIMIZATION. 

GO TO 10 


Figure 10: Exaaple 3; Gradients Supplied by the User 
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20 CONTINUE 

C GRADIENT OF OBJ. 

DF(1)=2.*SQRT(2.) 

DF(2)=1.0 

IF (NG7.SQ.0) GO TO 10 

C CONSTRAINT GRADIENTS. USB ARRAY B FOR TEMPORARY STORAGE. 

D1=(X(1)+SQRT(2.)*X(2))**2 
C G(l) , 

B(1,1)=-(2.*X(1)*X(1)+2.*SQRT(2.)*X(1)*X(2)4 2. *X(2)*X(2))/ 

1 (2. *X( 1)*X( 1)*D1) 

B(2,1)=-1./(SQRT(2.)*D1) 

C G(2) . 

B(? , 2)=-0. 5/DI 
B(2,2)=SQRT(2.)*B(1,2) 

C STORE APPROPRIATE GRADIENTS IN ARRAY A. 

DO 30 J=1,NGT 
K=IC(J) 

A(1,J)=B(1,K) 

30 A(2, J)=B(2,K) 

GO TO 10 
80 CONTINUE 

C PRINT RESULTS. 

WRITE(6,80) OBJ,X(l) ,X(2),G(1),G(2) 

STOP 

70 FORMAT (415) 

80 FORMAT (//5X, 7HOPTIMUM,5X,5HOBJ =,E12.5//5X,6HX(1) =,B12.5,5X, 

1 6HX(2) -,E12.5/5X,6HG(1) =,E12.5,5X,6HG(2) =,B12.5) 

END 


Figure 10 Concluded: Example 3; Gradients Supplied by the User 
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FORTRAN PROGRAM 
FOR 

AUTOMATED DESIGN SYNTHESIS 
VERSION 1.10 


CONTROL PARAMETERS 
ISTRAT = 0 IOPT 

IGRAD = 1 NDV 


4 IONED 

2 NCON 


7 

2 


IPRINT = 2020 


REAL 

1) 

PARAMETERS 
ALAMDZ = 

. 00000E+00 

20) 

EXTRAP 

= 

.50000E+01 

2) 

BETAMC 

= 

. 00000E+00 

21) 

FDCH 

= 

. 10000E-01 

3) 

CT 

- 

10000E+00 

22) 

FDCHM 


. 10000E-02 

4) 

CTL 

= 

-.50000E-02 

23) 

GMULTZ 


. 10000E+02 

5) 

CTIMIN 


. 10000E-02 

24) 

PSAIZ 

= 

. 95000E+00 

6) 

CTOIN 

= 

. 20000E-02 

25) 

RMULT 

= 

•50000E+01 

7) 

DABALP 


. 10000B-03 

26) 

RMVIMZ 

= 

. 20000E+00 

8) 

DABOBJ 

= 

. 38284E-02 

27) 

RP 

= 

. 10000E+02 

9) 

DABOBM 


. 38284E-01 

28) 

RPMAX 

= 

. 10000E+11 

10) 

DADSTR 


. 38284E-02 

29) 

RMULT 

= 

20000E+00 

ID 

DELALP 

= 

. 50000E-02 

30) 

RPPMIN 

= 

. 10000E-09 

12) 

DELOBJ 

= 

. 10000E-02 

31) 

RPPRIM 

- 

. 10000E+03 

13) 

DELOBM 

- 

. 10000E-01 

32) 

SCFO 

= 

. 1Q000E+01 

14) 

DBLSTR 

- 

. 10000E-02 

33) 

SCLMIN 

- 

. 10000E-02 

15) 

DLOBJ1 

r 

. 10000E+00 

34) 

STOL 

= 

. 10000E-02 

16) 

DLOBJ2 

- 

. 10000E+04 

35) 

THETAZ 

= 

. 10000E+01 

17) 

DXl 

= 

. 10000E-01 

36) 

XMULT 

= 

.26180E+01 

18) 

13X2 

= 

. 20000E+00 

37) 

ZRO 

- 

. 10000E-04 

19) 

EPSPEN 

= 

-.50000E-01 

38) 

PMLT 

= 

. 10000E+02 


INTEGER PARAMETERS 

1) ICNDIR = 3 

2) ISCAL = 1 

3) ITMAX = 40 


4) ITRMOP 

5) ITHMST 


2 

2 


ARRAY STORAGE REQUIREMENTS 

DIMENSIONED REQUIRED 
ARRAY SIZE SIZE 

WK 1000 197 

IWK 500 184 

Figure 11: Exaaple 3 - Output 


6) JONED 

7) J1MAX 


7 

20 
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IOPT = 4; METHOD OF FEASIBLE DIRECTIONS 


— INITIAL DESIGN 

OBJ = • 38284B+01 

DECISION VARIABLES (X- VECTOR) 

1) . 10000B+01 . 10000E+0I 

LOWER BOUNDS ON THE DECISION VARIABLES (VLB-VBCTOR) 
1) . 10000E-01 . 10000E-01 

UPPER BOUNDS ON THE DECISION VARIABLES (VUB- VECTOR) 
1) . 99746E+20 .10000B+21 

CONSTRAINT VALUES (G- VECTOR) 

1) -.41831B+00 -.79289E+00 


— ITERATION l 03J - .28261E+01 

DECISION VARIABLES VECTOR) 

1) .86779B+00 .37164E+00 


-- ITERATION 2 OBJ = .27594E+01 

DBCISION VARIABLES (X-VECTOR) 

1 ) . 38867E+00 . 81 159E+00 


— ITERATION 3 OBJ = .26402E+01 

DBCISION VARIABLES (X-VECTOR) 

1) . 80834E+00 . 35388E^00 


— ITERATION 4 OBJ = .26381E+01 

DBCISION VARIABLES (X-VECTOR) 

1) . 79603B+00 . 38657E+00 


— ITERATION 5 OBJ = .2S375E+01 

DBCISION VARIABLES (X-VECTOR) 

1) . 79037E+00 .401998+00 


Figure 11 Continued: Bxaaple 3 - Output 
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FINAL OPTIMIZATION RESULTS 


NUMBER OF ITERATIONS = 5 

OBJECTIVE = . 26375E+01 

DECISION VARIABLES (X-VECTOR) 

1) . 79037E+00 .40199E+00 

CONSTRAINT VALUES (G- VECTOR) 

1) . 80391B-03 -.63205K+00 

CONSTRAINT TOLERANCE, CT = -.51000E-01 CTL = -.30000E-02 

THERE ARE I ACTIVE CONSTRAINTS AND 0 VIOLATED CONSTRAINTS 
CONSTRAINT NUMBERS 
1 

THERE ARE 0 ACTIVE SIDE CONSTRAINTS 
TERMINATION CRITERIA 

RELATIVE CONVERGENCE CRITERION WAS MET FOR 2 CONSECUTIVE ITERATIONS 
ABSOLUTE CONVERGENCE CRITERJ N WAS MET FOR 2 CONSECUTIVE ITERATIONS 

OPTIMIZATION RESULTS 


OBJECTIVE FUNCTION VALUE 
DESIGN VARIABLES 


26375E+01 


VARIABLE 

1 

2 


LOWER 
BOUND 
. 10000E-01 
. 10000E-01 


VALUE 

. 79037E+00 
.40199E+00 


UPPER 
BOUND 
. 10000E+21 
. 10000E+21 


DESIGN CONSTRAINTS 

1) . 5629E-03 -.6320E+00 

FUNCTION EVALUATIONS = 16 

GRADIENT EVALUATIONS = 5 


OPTIMUM OBJ = .26375E+01 

X(l) = . 79037E+00 X(2) = .40199E+00 

G(l) = . 56288E-03 G(2) = -.63205E+00 

Figure 11 Concluded: Example 3; Output 
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6.Q MAIN PROGRAM FOR SIMPLIFIED USAGE OF ADS 

Figure 12 is a general-purpose calling progran for use with ADS. 
The array* are dimensioned sufficient to solve problem of up to 20 
design variables and 100 constraints. Arrays IC and A are dinensioned 
to allow for evaluation of 30 constraint gradients. Wherever a question 
nark (?) is given, it is understood that the user will supply the 
appropriate information. Note that the stateoent 1(1)=?, 1=1, NDV is not 
an inpl led FORTRAN DO LOOP, but simply denotes that the value of the NDV 
design variables Must be defined here. 

Subroutine KVAL is the user-supplied subroutine for evaluating 
functions and gradients (if user-supplied). The calling statement is: 

CALL BVAL ( INFO, NDV, NCON, OBJ, X,G,DF,NGT, IC, A,NRA) 

The parameter* INFO, NDV, NCON, NOT, IC and NRA are input to 

Subroutine EVAL, while OBJ, G, DF and A are output. Depending on the 
user needs, this say be simplified. For example, if IGRAD=0 and NDV and 
NCON are not required by the analysis, the calling stateaent say be 

CALL EVAL (OBJ.X.G) 

Also, a print control aay be added so, after the optiBization is 
coaplete, EVAL can be called again to print analysis information. 

C SIMPLIFIED USAGE OF THE ADS OPTIMIZATION PROGRAM. 

DIMENSION X(21) , VLB(21) , VUB(21) ,G( 100) , IDG( 100) , IC(30) ,DF(21) , 

V A(21, 30) ,WK( 10000) , IWK(2000) 

NRA=21 
NCOLA=30 
NRWR= 10000 
NRIWK=2000 

C INITIALIZATION. 

IGRAD=? 

NDV=? 

NCON=? 

X(I)=?, 1=1, NDV 
VLB(I)=?, 1=1, NDV 

VUB(I)=?, 1=1, NDV 

IDG(I)=? 1=1, NCON 
ISTRAT=? 

IOPT=? 

IONED=? 

IPRINT=? 

INFO=0 

10 CALL ADS ( INFO, ISTRAT, IOPT, IONED, IPRINT, 1GRAD, NDV, NCON, X, 

* VLB, VUB.OBJ.G, IDG.NGT, IC,DF,A,NRA,NCOLA,WK,NRWK, IWK.NRIWK) 

CALL BVAL ( INFO, NDV, Nv.ON, OBJ, X,G,DF,NGT, IC, A,NRA) 

IF (INFO.GT.O) GO TO iO 

C OPTIMIZATION IS COMPLETE. PRINT RBSULTS. 

STOP 

END 

Figure 12: Pr. gr am for Simplified Usage of ADS 
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QUICK REFERENCE TO ADS OPTIONS 


IOPT OPTIMIZER 

I Fletcher Reeves 

2 Dev! don Fletcher Powell ( t)FP) 

3 Brnydon Fletcher Ooldforb Hhanno ( BF08 ) 

i 4 Method of Feasible Dl root Ions 


i- 5 Modified Method of Feasible Directions 



STRATEGY ISTRAT IOPT 12 3 4 


None 0 X 
SUMT, Exterior 1 X 
SUMT, Linear Extended Interior 2 X 
SUMT, Quadratic Extended Interior 3 X 
SUMT, Cubic Extended Interior 4 X 
Augmented Lagrange Multiplier Moth. 5 X 
Sequential Linear Programming 6 0 
Method of Centers 7 0 
Sequential Quadratic Programming 8 0 
Sequential Convex Programming 9 0 

ONB-D DCNS IONAL SEARCH IONBD 


Golden Section Method 1 X 
Golden Section + Polynomial 2 X 
Polynomial Interpolation (bounded) 3 X 
Polynomial Extrapolation 4 X 
Golden Section Method 5 0 
Golden Section + Polynomial 6 0 
Polynomial Interpolation (bounded) 7 0 
Polynomial Extrapolation 8 0 


X 

X 

X 

X 

X 

X 

0 

0 

0 

0 


X 

X 

X 

X 

0 

0 

0 

0 


NOTE: An X denotes an allowed combination of algorithms. 


X 

X 

X 

X 

X 

X 

0 

0 

0 

0 


X 

X 

X 

X 

0 

0 

0 

0 


X X 
0 0 
0 0 
0 0 
0 0 
0 0 
X X 
X X 
X X 
X X 


0 0 

0 0 

0 0 

0 0 

X X 

X X 

X X 

X X 
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APPENDIX B 




USEFUL INFORMATION STORED IN ARRAYS NK AND IWK 



i 


Arrays WK and INK contain information calculated by ADS which is 
sometimes useful in monitoring the progress of the optimization. Tables 
B-l and B-2 identify parameters which may be of interest to the user. 
Note that these parameters must not be changed by the user during the 
optimization process. 


TABLE B-l: REAL PARAMETERS STORED IN ARRAY NK 


PARAMETER LOCATION DEFINITION 


ALPHA 


Move parameter in the one-dimensional search. 

4 . 

ALPHA3 

53 

Alpha at the strategy level for ISTRAT=8. 


PENALT 

82 

The value of the penalty in 8UHT methods. 


SLOPF 

86 

The slope of the OBJ versus ALPP* function in the 
one-dimensional search. 



‘A 
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TABLE B-2: 

INTEGER 

PARAMETER 

LOCATION 

IDAB 

23 

IDAB3 

24 

IDEL 

25 

1DEL3 

26 

IFCALL 

28 

IGO’ALL 

29 

IMAT 

34 


DEFINITION 


Number of consecutive times the absolute 
convergence criterion has been satisfied at the 
optimization level. 

Same as IDAB, but at the strategy level. 

Number of consecutive times the relative 
convergence criterion has been satisfied at the 
optimization level. 

Same as IDEL, but at the strategy level. 

The number of times the objective and constraint 
functions have been evaluated. 

The number of times analytic gradients have been 
evaluated. 

Pointer telling the status of the optimization 
process. 

0 - Optimization is complete. 

1 - Initialization is complete and control is being 
returned to the user to over-ride default 
parameters . 

Initial function evaluation. 

Calculating analytic gradients. 

Calculating finite difference gradients. NXFD 
identifies the design variable being changed. 
One-dimensional search is being performed. 

See LGOTO. 

45 Iteration number at the optimization level. 

46 Iteration number at the strategy level. 

54 Location in one-dimensional search. 


ITER 

JTER 

LGOTO 


NAC 

NACS 

NVC 

NXFD 


2 - 

3 - 

4 - 

5 - 


1 - Finding bounds on the solution. 

2 - Golden Section method. 

3 - Polynomial interpolation after Golden Section. 

4 - Polynomial interpolation after getting bounds. 

5 - Polynomial interpolation/extrapolation. 

58 Number of active constraints. 

59 Number of active side constraints. 

68 Number of violated constraints. 

69 Design variable being perturbed during finite 

difference gradients. 
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A PPE NDIX C 

SUBROUTINES NEEDED FOR A SP|CIFIIfi COMBINATION OF ISTRAT,. IOPT AND IONED 

Depending on the combination of ISTRAT, IOPT and IONED, only a 
subset of subroutines contained in the ADS system are used. Therefore, 
if computer memory is limited, it may be desired only to load those 
routines which are actually used. This will result in "unsatisfied 
externals" at run time, but on most systems the program can be executed 
anyway since the unsatisfied exter 1 routines are not actually called. 
Below is a list of the routines needed for a given combination of 
algorithms. In some cases, slightly more routines are included than are 
absolutely necessary, but they are short and a more precise list would 
be undully complicated. 

ALWAYS LOAD THE FOLLOWING SUBROUTINES: 

ADS, ADS001, ADS002, ADS004, ADS005, ADS006, ADS007, ADS009, ADS010, 

ADS 102, ADS103, ADS105, ADS112, ADS122, ADS201, ADS206, ADS211, ADS216, 

ADS236, ADS237, ADS401, ADS402, ADS403, ADS420, ADS503, ADS504, ADS506, 

ADS510 


STRATEGY LEVEL 

Depending on the value of ISTRAT, the following subroutines are 
also required: 


ISTRAT - 0, No strategy routines are added. Go to the optimizer level. 


ISTRAT = 1, 
ISTRAT = 2, 
ISTRAT = 3, 
ISTRAT = 4, 
ISTRAT = 5, 
ISTRAT = 6, 
ISTRAT = 7, 
ISTRAT = 8, 

ISTRAT = 9, 


Add: 

ADS008, 

ADS301, 

ADS302, 

Add: 

ADS008, 

ADS302, 

ADS303 , 

Add: 

ADS008, 

ADS302, 

ADS304, 

Add: 

ADS008, 

ADS302, 

ADS305, 

Add: 

ADS008, 

ADS302, 

ADS 306, 

Add: 

ADS320, 

ADS321, 

ADS323 , 

Add: 

ADS323, 

ADS330, 

ADS331, 

Add: 

ADS207, 

ADS371, 

ADS5G8, 

ADS217, 

ADS375, 

ADS509 

ADS218; 

ADS376, 

Add: 

ADS207, 

ADS509 

ADS217, 

ADS218, 


ADS508 

ADS308, ADS508 
ADS308, A0S508 
ADS308, ADS5C8 
ADS307 , ADS508 
ADS333 
ADS333 

ADS221 , ADS223, ADS310, ADS333, 
ADS377 , ADS378, ADS404, ADS507, 

ADS221, ADS223, ADS325, ADS326, 
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v 1 , 


V 


" t *. 


OPTI MIZER LEVEL 

Depending on the m' ae of IOPT, the following -ubroutinea ere also 
required: 

IOPT " 1, Add: ADS204, ADS213, ADS214, ADS509 

IOPT = 2, Add: ADS213, ADS21*. /UJS235, ADP404, ADS503, ADS509 

IOPT - 3, Add: ADS213, ADS214, ADS235, APS404, ADS503, ADS5C> 

IOPT = 4, Add: ADS201, ADS205, ADS207, ADS217, ADS218, ADS221, ADS223, 

ADS507 

IOPT = 5, Add: AOS201, ADS202, ADS203, ADS207, ADS209, ADS217, ADS2I8, 
A0S221, ADS223, ADS235, ADS507 


ONE -DI MENSIONAL SEA RCH LEVEL 

Tepending on the value of IONED, the following subroutines are also 
required: 

IONED = 1-4, Add: ADS116, ADS117, ADS118, ADS121, ADS126, ADS127 

IONED = 5-8, Add: ADS101, ADS104, ADS106, ADS108, ADS 109, ADS110, 

ADS111, ADS 115, ADS119, ADS123, ADS124, ADS125, 

ADS502 



appendix d 

ADS SYSTEM SUBROUTINES 


The subroutines in the ADC system are listed here with a very brief 
description of each. Most subroutines are internally documented, and 
the user is referred to the program listing for more details. 

Generally, ADS001 - aDSC' 99 are control level routines. ADS101- 
ADS199 are one-dimensional search level routines, ADS201-ADS299 are 
optimization level routines and ADS301-ADS399 are strategy level 
routines. ADS401-ADS499 are print routines and ADS501-ADS599 are 
utility routines. 


ROUTINE 


PURPOSE 


ADS - Main control routine for optimization. 

ADR001 - Control one-dimensional search level. 

ADS002 - Control optimizer level. 

ADS003 - Control strategy level. 

ADS004 - Define work array storage allocations. 

ADS005 - Initialize scalar parameters to their default values. 
ADS006 - Initialize scale factors. 

ADS007 - Calculate scale factors, scale, unscale. 

ADS008 - Calculate gradients of pseudo-objective for ISTRAT=l-5. 
ADS009 - Re-order IC and A arrays. 

^SOIO - Calculates convergence criteria parameters. 

ADS101 - Coefficients of linear polynomial. 

ADS102 - Coefficients of quadratic polynomial. 

ADS103 - Coefficients of cubic polynom il. 

ADS104 - Zeroes of polynomial to third-order. 

ADS105 - Minimums of polynomial to third-order. 

ADS106 - Evaluate n-th order polynomial. 

ADS108 - Find minimum of a function by polynomial interpolation. 
ADS109 - Find zeroes of a function by polynomial interpolation. 



PURPOSE 




ROUTINE 

ADS1I0 
AOSlll 
ADS 112 
ADS115 
ADS 116 
ADS117 

ADS118 

ADS119 

ADS121 
ADS122 
ADS 123 
A 3124 

ADS 125 
ADS 126 

ADS127 

ADS201 

ADS202 

ADS203 

&DS204 

ADS205 

ADS206 

ADS207 


- Evaluate slope of n-th order polynomial. 

- Polynomial interpolation for constraint boundaries. 

- Find ALFMAX so NDV side constraints are encountered. 

- Control one-dimensional search for constrained functions. 

- Control one-dimensional search for unconstrained functions. 

- Polynomial interpolation of unconstrained function, within 
bounds. 

- Polynomial interpolation of unconstrained function, no 
bounds given. 

- Polynomial interpolation of constrained function, no bounds 
given. 

- Find bounds on minimum of unconstrained function. 

- Initial interior points for Golden Section method. 

- Constrained one-dimensional search by Golden Section method. 

- Update bounds and get new interior point in Golden Section 
method, constrained. 

- Find bounds on minimum of constrained function. 

- Unconstrained one-dimensional search by Golden Section 
method. 

- Update bounds and get new interior point by Golden Section 
method, unconstrained. 

- Identify NGT most critical constraints. 

- Invert matrix B and store back in B. 

- Delta-X back to boundary in Modified Method of Feasible 
Directions. 

- Fletcher-Reeves unconstrained minimization. 

- Method of Feasible Directions. 

- X = Xold + ALPHAtS, subject to side constraints. 

- Maximum component (magnitude) of each column of A. 



ROUTINE 


PURPOSE 


ADS209 - Calculate B = A-Transpose tines A. 

ADS211 - Update convergence parameter* IDEL and IDAB. 

ADS213 - Calculate initial ALPHA for one-dinensional search based on 
objective function value. 

ADS214 - Calculate initial ALPHA for one-dinensional search based on 
X-values . 

ADS216 - finite difference gradients of objective and constraints. 

ADS217 - Solve direction-finding task for Methods of Feasible 
Directions. 

ADS218 - Solve special LP sub-problen froa ADS217. 

ADS221 - Push-off factors for Methods of Feasible Directions. 

ADS223 - Identify active side constraints. 

ADS231 - Modified Method of Feasible Directions. 

ADS235 - Variable Metric Methods, IOPT=2,3. 

ADS236 - Search direction for Variable Metric Methods. 

ADS237 - Penalty for equality constraints, I0PT=4,5. 

ADS301 - Exterior Penalty Function Method, ISTRAT=1. 

ADS302 - Calculates penalty for penalty function nethoda, I3TRAT=l-5. 
ADS303 - Linear Extended Penalty Function Method, ISTKAT=2. 

ADS304 - Quadratic Extended Penalty Function Metnod, ISTRAT=3. 

ADS305 - Cubic Extended Penalty Function Method, ISTRAT=4. 

ADS306 - Augmented Lagrange Multiplier Method, ISTRAT=5. 

ADS307 - Update Lagrange Multipliers, ISTRAT=5. 

ADS308 - Calculate penalty paraeeters, ISTRAT=5. 

ADS310 - Sequential Quadratic Programing, ISTRAT=8. 

ADS320 - Sequential Linear Progressing, ISTRAT-6. 

ADS321 - Control solution of LP sub-probles., ISTRAT=6. 
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ROUTINE 


PURPOSE 


ADS323 - Update move Halts, ISTRAT=6,7. 

A0S325 - Sequectial Convex Progressing, ISTRAT=9. 

ADS326 - Solve convex sub-problea, ISTRAT=9. 

ADS330 - Method of Centers, ISTRAT=7. 

ADS331 - Control solution of LP sub-problea, ISTRAT=7. 

ADS333 - Calculate aaxiaua constraint value. 

ADS371 - Control solution of QP sub-problea, ISTRAT=8. 

ADS375 - Teaporary objective, ISTRAT=8. 

ADS376 - Gradient of pseudo-objective for one-diaensional search, 
ISTRAT=8. 

ADS377 - Change in objective gradients, ISTRAT=8. 

ADS378 - Update Hessian aatrix, ISTRAT=8. 

ADS401 - Print arrays. 

AOS402 - Print array title and array. Calls ADS401 . 

ADS403 - Print scalar control paraaeters. 

ADS404 - Print Hessian aatrix. 

ADS420 - Print final optiaization results. 

ADS501 - Evaluate scalar product of two vectors. 

ADS502 - Find aaxiaua component of vector. 

ADS503 - Equate two vectors. 

ADS504 - Matrix-vector product. 

ADS506 - Initialize syasetric aatrix to the identity matrix. 

ADS507 - Normalize vector by dividing by aaxiaua component. 

ADS508 -- Calculate gradient of pseudo-objective for ISTRAT=l-5 . 
Called by ADS008. 

ADS509 - Identify active side constraints. 

4DS510 - Scale, unscale the X-vector. 
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